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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent tenm adjustment. See 37 CFR 1.704(b). 

Status 

1 )^ Responsive to communication(s) filed on 13 July 2007 , 
2a)\3 This action is FINAL. 2b)ISl This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Ciaims 

4) ^ Claim(s) 1-3.5A9.51 -65.67-80 and 82-92 is/are pending in the application. 

4a) Of the above clalm(s) 52. 53. 58. 67, 68, 73, 82, 83, 88 and 89 is/are withdrawn from consideration. 

5) n Claim(s) is/are allowed. 

6) IEI Claim(s) 1'3.5,49,5t54-57.60'65.69-72.75-80,84-87 and 90-92 is/are rejected. 
?)□ Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) n The specification is objected to by the Examiner. 

10)0 The drawing(s) filed on is/are: a)\3 accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
1 1 )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-1 52. 

Priority under 35 U.S.C. § 119 

12)n Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)n All b)n Some * c)D None of: 

1 Certified copies of the priority documents have been received, 

2. n Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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2) nH Notice of Draftsperson's Patent Drawing Review (PTO-948) 
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DETAILED ACTION 

1 . This action is responsive to communications: RCE/iamendment filed 7/13/2007, to the original 
application filed 7/18/2003, provisional application filed 8/8/2002. IDS filed 7/13/2007. It is noted that all 
references (including two application numbers referenced on said IDS have been considered and made of 
record. However, said two application numbers will remain stricken form said EDS, so as not to appear on 
the face of the patent upon issue. 

2. Claims 1-3, 5, 49, 51-65, 67-80 and 82-92 pending. Claims 52-53, 58, 67-68, 73, 82-83, 88-89 

have been withdrawn as per response to Restriction Requirement. Claims 90-92 have been added. Claims 
1, 60, 75 are independent claims. 

Continued Examination Under 3 7 CFR L 114 

3. A request for continued examination under 37 CFR 1.114, including the fee set forth in 37 CFR 
1 . 1 7(e), was filed in this application after final rejection. Since this application is eligible for continued 
examination under 37 CFR 1.114, and the fee set iforth in 37 CFR 1 . 1 7(e) has been timely paid, the 
finality of the previous Office action has been withdrawn pursuant to 37 CFR 1.114. Applicant's 
submission filed on 7/13/2007 has been entered. 
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Claim Rejections - 35 USC § 103 

4, The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 
rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 102 of this title, if 
the differences between the subject matter sought to be patented and the prior art are such that the subject matter as a whole would 
have been obvious at the time the invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

This application currently names joint inventors. In considering patentability of the claims under 
35 U.S.C. 103(a), the examiner presumes that the subject matter of the various claims was commonly 
owned at the time any inventions covered therein were made absent any evidence to the contrary. 
Applicant is advised of the obligation under 37 CFR 1 .56 to point out the inventor and invention dates of 
each claim that was not conraionly owned at the time a later invention was made in order for the examiner 
to consider the applicability of 35 U.S.C. 103(c) and potential 35 U.S.C. 102(e), (f) or (g) prior art under 
35 U.S.C. 103(a). 



5. Claims 1-3, 5, 49, 51, 54-57, 60-65, 69-72, 75-80 and 84-92 are rejected under 35 
U.S.C. 103(a) as being unpatentable over Gupta et al. (hereinafter ''Gupta"), US 6,546,405 B2 filed 
10/23/1997, issued 4/8/2003, in view of Hassell et al. (hereinafter Hassell) U.S. Publication No. 
2004/0107439 with continuation fiUng date of 2/8/2000. 

Regarding independent claim 1, Gupta teaches displaying an audiovisual production in fig. 2, 
col. 2 lines 36-64, and col. 5 line 19 - col. 6 line 64. Gupta teaches displaying a message relating to a 
portion of the audiovisual presentation, with a video playing in a predetermined size, along with a 
separate text window. Gupta teaches displaying and selecting temporal annotations fi-om a list, to which 
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playback of the multimedia document substantially commences (fig. 2, col. 2 lines 36-64, col. 5 line 19 - 
col. 6 line 64, and col. 18 line 5 - col. 19 line 31). It is noted that the selection within said list can be 
interpreted as a form of message indicator, and it is reasonable for the skilled artisan to interpret Gupta's 
invention as having the capability of selecting another indicator from said list while a multimedia 
document is playing. 

Gupta discloses wherein the process of displaying the given message comprises using a threaded 
messaging system in col. 8 lines 29-54 and col. 19 lines 32 - col. 22 line 63. Gupta teaches that by 
enabling annotation of temporal annotations, threads of discussion can develop (see Gupta column 10 
lines 23-30), facilitating collaboration and fruitful discussion (Gupta column 10 lines 29-30). Since 
discussion threads typically incorporate messages, the selection of an annotation as described above 
would result in a display of a threaded discussion accordingly. 

Gupta does not specifically teach ^'automatically resizing the first screen display size., including 
the playback of the audiovisual production'', and ^'providing a text window, wherein,.,. occupied by the 
first screen display size'\ However, Hassell teaches a program guide incorporating rich media (Hassell, at 
least Abstract). Hassell teaches two presentation layouts: the first comprises a full screen video (a first 
screen display size) with text, and any other content displayed as "overlays" over said video (Hassell 
Figure 37, paragraph [0147]). The second presentation comprises separate windows for video and "text 
update window" (Hassell Figure 36, paragraph [0146]). It is noted that said text update window may be 
used to display reviewer conwnents, notes, etc. Changing from the first, to the second presentation results 
in said video now displayed within a second smaller display window, with the text now in a window 
previously occupied by said video. It is additionally noted that Hassell teaches automatic resizing of video 
(Hassell at least Abstract, and paragraph [0013]). It would have been obvious to one of ordinary skill in 
the art at the time of the invention to apply Hassell to Gupta, providing Gupta the benefit of efficient 
display layouts. If a user selects an annotation which opens a long discussion thread, it would be desirable 
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for the text of said discussion to be encapsulated within . its own window space (as per Hassell), instead of 
overlain on said video, so as to not interfere with the displayed video. 

Regarding dependent claim 2, Gupta discloses wherein the message is alphanumeric text 
displayed in a text window in fig. 2, 3, col. 6 line 43 - col. 7 line 34, and col. 9 line 61 - col. 10 line 14. 

Regarding dependent claim 3, Gupta discloses accepting a signal from a viewer input device to 
resize an area used to display the audiovisual production in col. 5 lines 19-63. Gupta discloses accepting 
a signal from a viewer input device to allow resizing of the text window in col. 6 lines 43-64 and col. 9 
line 61 - col. 10 line 14. 

Regarding dependent claim 5, Gupta discloses wherein the message includes an icon defining a 
portion of the audiovisual production to be displayed upon selection of the icon in col. 9 line 45 - col. 10 
line 30. 

In regard to dependent claim 49, Gupta teaches selecting annotations from a list, and providing 
a table of contents (Gupta Figure 10, column 1 1 lines 27-35, colunm 2 lines 58-61), providmg reasonable 
suggestion to one of ordinary skill in the art at the time of the invention to interpret said lists as "headers" 
or titles - "subject lines", of messages, facilitating clarity of messages. 

In regard to dependent claims 51, 54, 55, 56, Gupta discloses wherein the process of displaying 
the given message comprising using a threaded messaging system in col. 8 lines 29-54 and col. 19 lines 
32 - col. 22 line 63. Gupta does not forcefully teach a message included in a thread. However, it would 
have been obvious to one of ordinary skill in the art at the time of the invention to include this, in view of 
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Gupta. Gupta teaches that enabUng annotation of temporal annotations, threads of discussion can develop 
(see Gupta column 10 lines 23-30), providing reasonable suggestion to the skilled artisan to include 
messages as part of threads, facihtating collaboration and fruitful discussion (Gupta column 10 lines 29- 
30). It is noted that threads of discussion (i.e. in a typical forum) typically involve user(s) analyzing some 
or all displayed messages (including headers and content bodies) in an expanded threaded view, 
facilitating ftirther discussion. 

In regard to dependent claim 57, Gupta discloses wherein the process of displaying the given 
message comprising using a threaded messaging system including groups of users with access rights in 
col. 8 lines 29-54 and col. 19 lines 32 - col. 22 line 63, Gupta does not forcefully teach removing a 
message indicator after a period of time. However, it would have been obvious to one of ordinary skill in 
the art at the time of the invention to include this, in view of Gupta. Gupta teaches that enabling 
annotation of temporal annotations, threads of discussion can develop (see Gupta column 10 lines 23-30). 
Since storage space in repositories are generally finite, it was well established within electronic forums 
using message threads at the time of the invention to encapsulate all messages within a container period 
of time (i.e. messages from 2005, etc.) as one indicator, providing reasonable suggestion to the skilled 
artisan to remove stale messages from a forum and archiving said stale messages, facilitating efficient 
collaboration and discussion (Gupta column 10 lines 29-30). 

In regard to independent claim 60, claim 60 reflects the apparatus comprising computer 
readable instructions used for performing the method as claimed in claim 1 , and is rejected along the same 
rationale. 
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In regard to dependent claims 61-65, 69-72, claims 61-65, 69-72 reflect the apparatus 
comprising computer readable instructions used for performing the method as claimed in claims 2-3,5, 
49, 49, 54-57, respectively, and are rejected along the same rationale. 

In regard to Independent claim 75, claim 75 reflects the medium comprising computer readable 
instructions used for performing the method as claimed in claim 1, and is rejected along the same 
rationale. 

In regard to dependent claims 76-80, 84-87, claims 76-80, 84-87 reflect the apparatus 
comprising computer readable instructions used for performing the method as claimed in claims 2-3, 5, 
49, 49, 54-57, respectively, and are rejected along the same rationale. 

In regard to dependent claim 90, Gupta teaches a video and text display with a menu list (see 
rejection of claim 1). Gupta does not specifically teach full screen video view with an overlain message 
indicator. However, Hassell teaches fiill screen video with text, and any other desired content displayed as 
"overlays" over said video (Hassell Figure 37, paragraph [0147]). It is reasonable to interpret "any other 
desired content" as incorporating text messages, lists, menus, etc. It would have been obvious to one of 
ordinary skill in the art at the time of the invention to apply Hassell to Gupta, providing Gupta the benefit 
of efficient display layouts. If a user selects an annotation, it would be desirable for said annotation 
indicator to be overlain on a video, so as to allow a user the benefit of fiill screen video. 

In regard to independent claim 91, claim 91 reflects the medium comprising computer readable 
instructions used for performing the method as claimed in claim 90, and is rejected along the same 
rationale. 
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In regard to dependent claim 92, claim 92 reflect the apparatus comprising computer readable 
instructions used for performing the method as claimed in claim 90, and is rejected along the same 
rationale. 

Response to Arguments 

6. Applicant's arguments with respect to pending claims have been considered but are moot in view 
of the new ground(s) of rejection. Applicant's arguments are substantially directed to amended subject 
matter, which is currently taught by newly cited reference Hassell. 



Conclusion 

7. Any inquiry concerning this communication or earlier communications from the examiner should 
be directed to William L. Bashore whose telephone number is (571) 272-4088. The examiner can 
normally be reached on 9:00 am - 5:30 pm EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, Doug 
Hutton can be reached on (571) 272-4137. The fax phone number for the organization where this 
application or proceeding is assigned is 571-273-8300. 
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8. Information regarding the status of an application may be obtained from the Patent Application 
Information Retrieval (PAIR) system. Status information for published applications may be obtained 
from either Private PAIR or Public PAIR. Status information for unpublished applications is available 
through Private PAIR only. For more information about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a USPTO Customer 
Service Representative or access to the automated information system, call 800-786-9199 (IN USA OR 
CANADA) or 571-272-1000. 



WHXIAMBASHORE 
PRIMARY EXAMJNER 

September 27, 2007 



